Non-Abelian Brill-Noether theory 
and Fano 3-folds 

Shigeru Mukai * 



The Jacobian variety of an algebraic curve C is one connected component of 
the moduh space of hne bundles over C; the moduli space of vector bundles can 
be viewed as a non-Abelian generalization of this. Here we fix a line bundle ^, 
and consider the moduli space of rank 2 vector bundles with fixed determinant: 



stable rank 2 vector 
bundles E over C 



(isomorphism). 



The number hP{L) of linearly independent section of a line bundle L can be 
used to define subschemes of Jac C, called the Brill-Noether locuses. These 
have been studied since the 19th century, since they reflect properties of an 
individual curve that are beyond the control of the Riemann-Roch theorem. In 
this article, we recall this theory briefly in §2, then generalize it to the moduli 
spaces Mc(2,^), and give applications to Fano manifolds and curves on K3s. 
There are various types of generalizations; here we treat Types II and III. For 
Type I, see, for example, p3, Q. 
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SL(2,C) 
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hom(F, E) 


^hom(F, E)^^ 


SL(2,C) 


Mc{2,Kc) 


Type III 


h°{E) 


^%E) + 1^ 



The moduli spaces Jac C and Mc(2, ^) are Kahler manifolds, but their under- 
lying structures of symplectic manifolds parametrize unitary representations of 
the fundamental group 7ri(C). Here JacC parametrizes representations in U(l), 
and if ^ has even degree then Mc(2, ^) parametrizes irreducible representations 
in SU(2) (see Narasimhan and Seshadri fs^). 
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From now on, we let C be a curve of genus > 2. As is well known, the 
universal cover of C is the upper half-plane H = {Imz > 0}. We fix a subgroup]] 
r C SL(2,IR) which maps isomorphically to t^i{C) under the natural surjective 
homomorphism SL(2,K) AntH, and consider the space Si{T,p) of auto- 
morphic forms of weight 1 with coefficients in p. In the classic case, when 
d — g ~ 1, the Brill-Noether locuses Wg_i are nothing other than the theta 
divisor 8 C JacC of the Jacobian and its singular sets; these parametrize 
representations p: F — *■ U{1) for which dimS'i(F,p) > r + 1. 




In a similar way, the Type III Brill-Noether locuses 
Mc(2, K, n)^ {E\ h"{E) >n + 2} 
parametrize irreducible representations p: T SU(2) for which the space 



SiiT,p) 



f{z) and g{z) are holomorphic functions 
a 5^ 
c d I 

jy^ az+b -j 



on H, and for all 7 = 

= {cz + d)p{j) 



cz-\-d ' 



cz-\-d ' 



e F 



of vector valued automorphic forms of weight 1 has dimension > n + 2. 

The study of Brill-Noether locuses in practical cases is an illustration of the 
power of determinantal formalism for defining equations. §1 recalls the general 
theory of determinantal locuses. It is interesting to note that the 3 different 
types of non-Abelian Brill-Noether locuses have different types of determinan- 
tal forms. Brill-Noether locuses of Type III are defined by conditions on the 
dimension of intersection of two Lagrangian subspaces in a symplectic vector 
space (see §5). Similarly, Brill-Noether locuses of Type II are defined as sub- 
schemes as the set of points where a skewsymmetric homomorphism between 
two dual (or twisted dual) vector bundles drops rank (see §6). 

^This is the same thing as a theta characteristic or spin structure on C, that is, the choice 
of an element in ^Kq- 
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One of the original examples inspiring our interest in non-Abelian Brill- 
Noether locuses was the linear section theorem for a general curve of genus 8: 

C = Grass(2, 6) n Hi n H2 n ■ ■ ■ n Hr 

(see ||2l|, [^); to prove this, we had to construct an element E G A/c'(2, i^) 
such that hy{E) > 6. The theorem itself has its origins in the classification of 
Fano 3-folds, and Brill-Noether locuses have many other nice applications to 
Fano 3-folds. The point is that certain Fano 3-folds are realized as special cases 
of Brill-Noether locuses of Type III and Type II. Thus for a curve of genus 7, 
the Brill-Noether locus Mc{2,K,3) = {h°{E) > 5} is a Fano 3-fold of genus 7 
(see §8). Similarly, for a given stable vector bundle F over a curve C of genus 
3, the locus Mc{2,K: 3F) = {hom(F,£:) > 3} is a Fano 3-fold of genus 9 (see 
§9). In this sense, the current article follows on from [ p4[ . 

Non-Abelian Brill-Noether locuses are also closely related to vector bundles 
over K3 surfaces. It is known that any 2-dimensional component of the moduli 
space of these is again a K3 surface. The search for this kind of phenomenon 
over curves is a further inspiration for our study of non-Abelian Brill-Noether 
locuses. In this vein, we are following on from For moduli spaces of vector 
bundles E over a surface, we obtain varieties of various dimensions by changing 
the specified value of the second Chern class C2{E); for curves, changing the 
number of global sections hP{E) or the number of homomorphisms hom(F, i?) 
can be viewed as a substitute for the choice of C2{E). In the final section §10, 
as an application of this idea, we try out a non-Abelian version of the Albanese 
morphism; when a curve C is contained in a K3 surface S, we show how to 
recover S from C in terms of double moduli, that is, a twice iterated moduli 
construction. 

Notation and terminology We consider algebraic varieties over the complex 
numbers C. We write V"^ or i?^ to denote the dual of a vector space 1^ or a vector 
bundle E, and x(i?) = X^(— 1)'^*(^^) for the Euler-Poincare characteristic. 

1 Determinantal subschemes 

It frequently happens that an algebraic variety can be defined by a system of 
equations given as the minors of a matrix. The most basic case of this is the 
degeneracy locus of a homomorphism / ; E ^ F oi vector bundles over a variety 
X. 

Definition 1.1 We write Dk{f) for the set of zeros of the fcth exterior power 
of/ 

A; k k 

more precisely, Dk{f) is the zero subscheme of /• We also write D^{f) = 
Dr~k{f), where r = ranki^. 
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The homomorphism / is locally expressed as a matrix with entries regular func- 
tions on X, so that Dk{f) is the locus (subscheme) of common zeros of all the 
k X k minors of this matrix. Thus as subsets of X, Dk{f) and D'^{f) are equal 
to 

{a; e X I rank(/fc : E^^ — > F^) < k} and {a; G X | dimker(/fc : Ej. ^ F^) > k}. 



Proposition 1.2 ([Q) Suppose that X is nonsingular. Then 

(1) dim£'fc(/) > dimX— (r — k){s — k), where r and s are the ranks of E and 
F; we assume here that Dk{f) is nonempty. 

(2) Dk-i{f) is contained in the singular locus of Dk{f). 

(3) Write p for the right hand side of the inequality of (1). Then Dk{f) is 
nonsingular of dimension p at a point x G Dk{f) \ Dk-i{f) if and only if 
the linear map 

keifx «) (coker/^)^ m^/ml 
corresponding to x is injective. 

(4) The Giambclli-Thom-Porteous formula: define the Chern polynomial of 
the homomorphism f by 



E^^(/)^'= E^'(^)^M E^»(^)*' 



where Ci{f) G H^^{X). Assume that equality holds in the inequality of (1). 
Then the fundamental cohomology class of Dk{f) is given by the following 
Schur polynomial in the Chern classes of f : 



[Dkif)] 



fc(c(/))Gi/^^-^''(X), 



where N = dimX. 

Here in (4), the Schur polynomial Aai.a2,....a„ (c) is defined quite generally 
for Ai > A2 > • • ■ > Am as the determinant of the matrix having (i, j)th entry 
Cx^-i+j. In other words, 



Aai,A2,...,a„(c) = det 



CAi CAi + 1 CAi+2 

CA2-I CA2 CAi + 1 



Assume that Dk-i = 0, and that the assumption in (3) holds for all x G 
Dk{f). In this case, the conormal bundle to Dk{f ) in X is isomorphic to 



ker 



(/|i?(/))®coker(/|^^^^)^ 



(1.3) 
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In cases when the matrix representing a homomorphism of vector bundles is 
symmetric or skewsymmetric, the dimension of the degeneracy locus is bigger 



than the p in Proposition 1.2, so that (3) and (4) are not meaningful as they 
stand. However, we can modify them to make them meaningful. Consider first 
the symmetric case. Perhaps the obvious way to get symmetry is to take a 
homomorphism / from a vector bundle E to its dual E'^ satisfying — J . In 
this case, the degeneracy locus D^{f) satisfies the following. 

Proposition 1.4 (1) dimD^{f) > dimX - fc(fc + l)/2. Here we assume that 
D^[f) is nonempty. 

(2) D^^^{J) is contained in the singular locus of D^{f). 

(3) Write a for the right hand side of the inequality in (1). Then D^{f) is 
nonsingular of dimension a at a point x G D^{f ) \ D^'^^{f ) if and only if 
the linear map 

S'^keifa; -^m^/ml 
corresponding to x is injective. 

(4) The Harris- Tu formula |ll| : // equality holds in the inequality of (1) then 
the fundamental class of D^{f) is given by the Schur polynomial: 

[D\f)] = 2'=Afe,fe_i.....2,i(c(£;^)) e 
where N = dim X . 

A case when the appearance of symmetry is perhaps slightly less obvious 
is that of a pair of Lagrangian subbundles. As a warming up exercise, con- 
sider a finite dimensional vector space V with a skew inner product, that is, a 
nondegenerate skewsymmetric bilinear form 

( , ) -.VxV^C 

A vector subspace L C V with 2dimL = dimV such that the skew inner 
product ( , ) restricts to zero on L is called a Lagrangian subspace. Note that 
the quotient space V/L is then dual to L under the skew inner product ( , ). 
Given a pair (Li,i2) of Lagrangian subspaces, the composites 

Li^V ^ V/L2 = and L2 V" ^ V/Li = Li^ 

provide us with two linear maps. Now clearly, these are dual to one another, 
and both have the same kernel Li n L2. 

Example 1.5 If Li is a vector space and Li^ its dual, we can give the direct 
sum V = Li® Li^ the standard skew inner product 



/„ 
-/„ 



where n = dimLi. 
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The two direct summands Li and Li^ are both Lagrangian subspaces. Now let 
L2 be an n-dimensional subspace of V with Li^ n L2 =0; any such L2 is the 
graph of a hnear map /: Li^ — s- Li, 

r/ = {(/(x),x) I xeLi^}. 

We easily check the following: 

(1) Linia =ker/; 

(2) ^2 = T/ is a Lagrangian subspace if and only if / is symmetric. 

To globalize the above construction, we now consider a vector bundle V 
together with a skew inner product 

( , ) : V X $ 

with values in a line bundle <&. A Lagrangian vector subbundle £ C V is defined 
as above, and we consider a pair (£i,£2) of such. 

Definition 1.6 Consider the composite of inclusion and quotient maps 

We write D''{£i,£2) for its degeneracy locus; as a set, it is the locus oi x £ X 
such that dim£i_a; n £2,x > k. 



Example 1.7 Consider the direct sum V of a vector bundle C and its dual 
with the standard skew inner product. The graph of a symmetric homo- 
morphism /: £^ — > £ is a Lagrangian subbundle C V, and for every x € X 
we have Cx n Tf^^ = ker/^;. Thus D^(C,T f) coincides with D^(f). 

Locally, any pair (£i,£2) of Lagrangian vector subbundles can be written 
in terms of a symmetric homomorphism as in Example L7, so that D''{Ci, C2) 
is the set of common zeros of the minors of a symmetric matrix. 

Proposition 1.8 (1) dimD'=(£i,£2) > dimX - fc(fc + l)/2; here we assume 
that D'"'(£i,£2) is nonempty. 

(2) _D'^'+^(£i, £2) is contained in the singular locus o/Z?'^(£i, £2). 

(3) Write a for the right hand side of the inequality of (1). Then D''{Ci, £2) 
is nonsingular of dimension a at a point x G D''{£i, £2) \ D^^'^{£i,£2) 
if and only if the linear map 

$-1 (g) S'2(£i,:, n £2,x) m^/ml 

corresponding to x is infective. 
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Formulas for the fundamental class of the degeneracy locus D'^{Ci,C2) have 
been obtained by Pragacz and Fulton |^); the former uses the Schur 

Q-polynomials . 

Assume that £2) = 0, and that the assumption in (3) of the Propo- 

sition holds for every x G D''{Ci, C2); then, as in (1.3), we get an exact sequence 

(1.9) 



0^ f^D(£i,£2) ^ |d(£i,£2) 



We finally consider the skewsymmetric case. For an n x n skewsymmetric 
matrix A = (aij)i<i.j<„, with 0^ + aji — 0, it is well known that 



det A 

Here the Pfaffian of A is 



if n is odd; 

(Pfaff A)^ if n is even. 



Pfaff A = 2^7^ X! Sgn(cr)a^(i)o-(2) • • • ao-(2n-l)a(2n) ■ 

Let f : E ^ be a skewsymmetric homomorphism of vector bundles, that 
is, /^+/ = 0. The usual way of defining the degeneracy locus of / in terms of mi- 
nors is unsuitable, because it introduces an unwanted nilpotent structure. The 
right method is to replace the minors by the Pfaffians of principal submatrixes 
of even order. Note first that the rank of fx-E^—^ E^^ is automatically even 
for any x G X. Write r = ranki?; then for an integer v >{) with v = r mod 2, 
we define 

P^if) = {x e X \Ta.nkfx <r~ v}; (1.10) 

— locus of common zeros of the Pfaffians of 
(r — v) X (r — v) principal submatrixes 
of a skewsymmetric matrix representing /. 

In this display, the first line defines P^if) as a point set; the second line only 
makes sense locally, but provides a system of defining equations for P^{f). Thus 
putting the two together defines the subscheme structure of P'^{f). 

Proposition 1.11 (1) If P'^{f) is nonempty then 

dimP^if) > dimX - v{v - l)/2. 

(2) P'^^^(f) is contained in the singular locus of P'^{f). 

(3) Write r for the right hand side of the inequality of (1). Then P'^{f) is 
nonsingular of dimension t at a point x G P^{f) \ P'^^'^if) if and only if 
the linear map 

ker fx m/ml 

corresponding to x is injective. 
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(4) The Harris-Tu formula |Tl| : // equality holds in (1) then the fundamental 
class of P'^{f) is given by 

[P'^if)] - A,_i,,_2,...,2,i(c(i?^)) G H'''-''^''-'Hx), 
where N = dhnX. 



Remark 1.12 For a line bundle $, we say that a homomorphism f : E 
E"^ (g) $ is twisted skewsymmetric if (8) 1$ + / = 0; then (4) holds on replacing 



c{E) by c{E (g) v$ ) (the squaring principle of Harris and Tu, see ) . 

Assume that P'^+'^ ^ and that the assumption of (3) holds for every 
X E P'^{f). Then, as in (1.3) and (1.9), we get the exact sequence 



Pif) 



X 



Pif) 



*"V(/)®A ker(/|p(,)) 



0. 



(1.13) 



Remark 1.14 In (4) of Proposition |l.ll| , the right hand side is a polynomial 
in the Chern characters chi(E) of E, and this formula contains only the Chern 
characters of odd degree. For example, when = 3 or 4, we get 



A2,i(c(£;^)) 

A3,2,l(c(£^'')) 



C2 C3 
1 Cl 



C3 C4 C5 
Cl C2 C3 
1 Cl 



45 



cjch3 + 24cich5 - 4ch3. 



Remark 1.15 The 3 types of degeneracy locus in Propositions 1.2, 1.8 and [l.ll| 
correspond to the bounded symmetric domains of Type 1^,5, Type III (Siegel 
upper half-space) and Type II. 



2 Brill— Noether theory 

The set 77^(0 J) of isomorphism classes of all holomorphic line bundles over a 
curve C has a natural complex structure. This is called the Picard variety of C, 
denoted by PicC. The degree of a line bundle decomposes PicC as the disjoint 
union of its connected components: 

Pic'^C — I deg^ = d} / (isomorphism). 

The short exact sequence 

^ Z o ^ 0* 1 



8 



of sheaves over C induces the long exact cohomology sequence 



> H\C,Z) H\Oc) H^{0*c) i?2(C,Z) 0, 

and one sees from this that Pic" C is a g-dimensional complex torus, where g is 
the genus of C. The classic Brill-Noether locuses for curves are defined inside 
Pic'' C by setting 

= {£, I degC = d and > r + l} C Pic"* C. 

The number of linearly independent global sections of ^ is an upper- 

continuous function of Pic"^ C, so that the are closed subsets of Pic"^ C. We 
leave the definition of the WJ as subschemes until later, and list their known 
properties (compare 

(2.1) dim W^J > g — (r + l)(r — d + g). The right hand side is called the 
Brill-Noether number, and is usually denoted by p. 

(2.2) W^^^ is contained in the set of singular points of W^. 

(2.3) Suppose that the hue bundle ( is in \ WJ"*"^, in other words, that 
iJ"(^) is exactly (r + l)-dimensional. Then is nonsingular of dimension p 
at the point [^] if and only if the multiplication map (called the Petri map) 



is injective. 



(2.4) If equality holds in the inequality of (2.1) then the fundamental class of 
is given by 

[VF;] = X{r,d,g)e3-P e H^3-2p(p-^d^y 
Here 6 is the theta divisor, and we set 



A(r,d,5)=n 



(2.5) If the Brill-Noether number p is nonnegative then is nonempty (see 
[ p^ , 0). Also, if p > then is connected (||]). Conversely, for a general 
curve C £ Mg, if p < then = 0. 

We give the point set C Pic'^C a subscheme structure as the degen- 
eracy locus of a homomorphism of vector bundles. We choose distinct points 
Pi, ... , P/v on C, and define a divisor D as their sum, D = Y^f^i Pi- We choose 
N sufficiently large so that H^{S^{D)) = for every <^ e Pic"^ C. Now consider 
the short exact sequence of sheaves on C 

N 

o^C->e(i^)^0e(i^)|p^^o 

1=1 
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and the induced cohomology long exact sequence 

N 

H'^iO ^ H^im) ^ 0ff°(CP)|p,) - H\0 - 0. (2.6) 

We obviously have ft.'^(^) — h'^{(,{D)) — ranka^. Now globalizing this, we get a 
homomorphism of vector bundles over Pic'' C of the form 

N 

A= JJ a^: E= H H°{C{D)) F = ^ F,, (2.7) 

CePicC ^(EPicC 1=1 

where Fi = U^gpicc -^°(^(-^)|p. )■ ^ more precise way, let £ be a 

Poincare line bundle. That is, £ is a line bundle on the product C x Pic'' C such 
that = ^ for every ^ G Pic'' C. Consider the exact sequence of sheaves 

O^C^C ®Oc Oc{D) -> C ®Oc Od{D) ^ 

on the direct product; then taking direct images with respect to the second 
projection tt : C x Pic'* C Pic'* C induces the cohomology long exact sequence 

^ 7r,£ ^ Ti^iC ®Oc Oc{D)) ^ 7r,(£ (E)Oc Od{D)) -> R^nX -> 0; 



the homomorphism A appearing here gives the precise definition of (2.7). In 
fact, A restricted to the fiber over each point [£] G Pic'' C is exactly the of 

(El)- 

Definition 2.8 We define the subscheme structure of the Brill-Noether locus 
Wl C Pic'' C as the de generacy locus D^'^^{A) of the above homomorphism of 
vector bundles 

A:tt^{C ®Oc Oc{D)) ^ 7r,(£ (g)Oa Od{D)). 



The assertions (2.1), ( |2.2| ), (2.3) follow easily from this definition and Propo- 
sition (But to get ^ when p > 0, we also have to prove that 
X{r,d,g) 7^ 0.) By the Grothendieck-Riemann-Roch theorem, one sees that 
the Chern class polynomial '^i>QCi{A)t^ of the vector bundle homomorphism 
A is equal to exp(t9); therefore a calculation based on Proposition O, (4) gives 



that the fundamental class of is 



V ' 

r + 1 timoa 

This is (PI). 
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Remark 2.9 The scheme structure of just defined is independent of the 
choice of the auxiliary divisor D — J^iLi Pi- fact, by definition, is the 
subscheme defined by a Fitting ideal of the cokernel of the homomorphism A, 
which is the first higher direct image sheaf R^tt^C; however, the Fitting ideal of 
a module is independent of its realization as the cokernel of a homomorphism 
of vector bundles (sec |37[| ). 



3 The moduli space of stable vector bundles 

The set of isomorphism classes of all holomorphic vector bundles of rank r over a 
curve C is equal to the cohomology set iJ^(GL(r, Oc))- However, in contrast to 
the case of line bundles (r = 1), before we can give this set a complex structure, 
we first have to restrict the set of vector bundles under study. 



Definition 3.1 (Mumford |27|) A rank 2 vector bundle E over a curve C is 
stable if ^ 

deg^ < -deg£: 

for every line subbundlc ^ d E. Moreover, if the inequality holds in the weaker 
form <, we say that E is semistable. 



We consider the moduli space 



/\^E ^ ^ ^ / (isomorphism). 



stable rank 2 vector 
bundles E over C 

of stable vector bundles over C with fixed determinant line bundle ^. The first 
thing to note is that the set of all first order infinitesimal deformations of E is 
parametrized by the vector space {End E) . Here End E is the sheaf formed by 
the (local) endomorphisms of i?, or in other words, End E = E^ ® E. However, 
End E splits as a direct sum 

Oc ■ \A®5iE, 

where the first summand consists of scalar multiplication by functions, and the 
second of endomorphisms having zero trace. Simple considerations lead to the 
following facts: 

(3.2) Infinitesimal deformations that leave det E invariant are parametrized by 
the subspace H^{5lE). Stability of E is an open condition, preserved by small 
perturbations; thus H^{slE) is the tangent space to the moduli space Mc(2,^) 
at the point [E]. Obstructions to deformations live in the space H^{slE), which 
is zero for reasons of dimension. Also, by the Riemann-Roch theorem, H^{5lE) 
has dimension 3g — 3, so that we obtain the following result: 

(3.3) Mc(2,^) is nonsingular and of dimension 3^ — 3. 

We now consider the global structure. By Geometric Invariant Theory 
(p^), Mc(2,^) is a quasiprojective algebraic variety (see p^, Q). Up to 
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isomorphism, it only depends on the parity of deg^. For odd degree, Mc(2,^) 
is projective, and in particular compact; its second cohomology group is iso- 
morphic to Z, and its first Chern class ci equal to twice the positive generator. 
Thus Mc(2,^) is a Fano manifold of dimension 3g — 3 and index 2 (see |40||). 
For a hyperelliptic curve C, it has the following concrete description. 

Theorem 3.4 (Desale— Ramanan |^) Let C be the hyperelliptic curve de- 
fined by the equation y^ = Yi^^^i^ ~ ^i)- Then the odd moduli space Mci^,^) 
is the closed subset of the Grassmannian variety Grass(.g, 2g + 2) consisting of 
(g — l)-planes o/P^^"*"^ contained in the complete intersection of two quadrics 
Vi C P2f+i defined by 

/2g+2 2g+2 \ 

The even moduli space Mc(2,^), that is, when ^ has even degree, is not 
compact. However, it is contained as an open set in a projective algebraic 
variety M(7(2,^), with points of the boundary parametrizing the isomorphism 
classes of bundles that are direct sums of the form 

L®£,L-^ forLePic''C, where d = degC/2. 

In more rigorous terms, Mc;(2, ^) is the moduli space of so-called ^-equivalence 
classes of semistable bundles. It is singular along the boundary (the case of 
genus 2 is an exception); however, the anticanonical line bundle exists, and 
Mc(2,^) is a singular Fano manifold of index 4 (see ( [f.4| ) below). 

We can construct a natural map from the even moduli space Afc(2,^) to 
projective space as follows. Write d ~ deg^/2, and set 

DE = {r]\ H^{E®ri-^) 7^ 0} C Pic''+^"3 C for £; e Mc(2, $). 

This is a codimension 1 subvariety, and as a divisor, it is an element of the linear 
system |20|; we thus obtain a morphism 

Mc(2,0 ^ F'""' = |2e|, given hy E ^ De- 
This morphism extends naturally to the compactification Mc(2,^) (see or 

[ID- 

Examples 3.5 (1) For a genus 2 curve C, the above morphism is an iso- 
morphism Mc(2, ^)^P'^, and the boundary of the compactification maps 
to the Kummer quartic surface associated with the Jacobian variety Jac C. 

(2) Consider the above morphism 

Mc(2,a^P^ 
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for a genus 3 curve C. If C is hyperelliptic, then it is a double covering 
of the quadric Q^. For nonhypereUiptic C, that is, when C is a plane 
quartic, it is an embedding, with image a quartic hypersurface (see p^). 
This quartic hypersurface is singular along the Kummer 3-fold of Jac C, 
and its defining equation can be derived from this fact (see |^). 

We now explain the Hecke correspondence between the even and odd moduli 
space (compare and ^9|). For a rank 2 vector bundle E and a point p, 
suppose that we are given a 1-dimensional subspace of the fiber Ep-, write Ep 
k{p) for the linear map with this as kernel. Now consider its composite 

E Ep ^ k{p) 

with the natural projection map E ^ Ep = E/mpE. Its kernel F is a vector 
bundle over C; we say that F is obtained by pinching E at p. We have /\^F = 
(/\"i?)(— p), so that deg-F = degE — 1. Taking the dual of the exact sequence 
defining F 

0-^ F ^ E ^ k{p) 

gives an exact sequence 

0^ E"" ^ F"" ^ kip) -> 0. 

Thus conversely, we can also recover E'^ by pinching at p. To express this 
contruction geometrically, given the P^-bundle V{E) and a point x on it, we 
first blow up P{E) at x, then contract the birational transform /' of the fiber / 
through a: to a point y, thus obtaining a new P^-bundle P{F). 

We now fix a line bundle ^ of odd degree and a point p of C. Moreover, 
let £ be the universal vector bundle over the direct product C x Mc(2,^), 
and write £p for its restriction to p x Mc(2,^). For each E e Mc(2,^) we 
have — E, so that the fiber of £p at [E] is isomorphic to the fiber 

Ep of E at p. We write Z = V{£p) for the P^-bundle over Mc(2,^) obtained 
by projectivizing Sp] it parametrizes pairs consisting of a stable vector bundle 
E S Mc{'2,£,) together with a 1-dimensional vector subspace of the fiber Ep at 
p. For a point Z 3 z = {E,fz: Ep C), we write F^ for the vector bundle 
obtained by pinching i? at p as described above. Fz is defined by the exact 
sequence 

0^ Fz^ E ^ k{p) 0. 

Now since E is stable and of odd degree, F^ is semistable. We therefore obtain 
a classifying map 

Z ^Mc{2,a-p)) 
from Z to the moduli space, defined by z [Fz]- The correspondence 

Z ^ Mc{2,a~p)) 
Pi-bundle i (3.6) 

Mc(2,C) 
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1 
I 



P(£) 




obtained in this way is called the Hecke correspondence. In what follows, we 
refer to Z as the Hecke graph; it can alternatively be viewed as a moduli space 
of stable parabolic bundles (compare |4l] , ) . 

(3.7) Over the open subset AIc{'2,£,{—p)), every fiber of ip is isomorphic to 
the projective line P^. (Over boundary points, the behaviour of ip provides 
interesting examples of extremal rays.) 

(3.8) There exists a vector bundle !F over the direct product C x Z with 
^1^^^ = Fz for each point z (z Z. This is obtained from the universal bundle 

£ over C x Mc{'2,(,{~p)) by taking the puUback (1 x tt)*£ and then pinching 
it as follows: because Z = ¥{£p), it has a tautological line bundle Oz{H), 
together with a tautological surjective sheaf homomorphism TT*£p Oz{H) 
0. Noting that £p = '^|pxM' need only take J- to be the kernel of the 
composite homomorphism 

{lx^r£^^*£^^^^^Oz{H). 
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4 Non-Abelian Brill— Noether locuses 
of Type III 

The even moduli space admits two particular cases, when ^ is equal to the trivial 
bundle Oc or the canonical line bundle Kq- 

Theorem 4.1 (Narasimhan Seshadri p^, Donaldson |^) For a rank 2 
vector bundle E over C , the following 2 conditions are equivalent. 

(1) E G Mc{2, Oc), or in other words, E is stable and /\^E = Oc- 

(2) E is aflat bundle obtained from an irreducible SU(2) representation of the 
fundamental group 7ri(C). 

In particular, Mc{2,Oc) can be identified with the set of equivalence classes 
of irreducible representations o/tti in SU(2). 

The other particular case, the moduli space Mc{2^K) of bundles with the 
canonical bundle as determinant, parametrizes representations p: T SU(2), 
where F C SL(2,R) is a lift of tti (see the introduction). 

Proposition 4.2 The space H^{E) of global sections of a bundle E E Mc{2, K) 
is isomorphic to the space Si{T,pe) of automorphic forms with coefficients in 
the corresponding representation pE- 

We use the dimension of this vector space to define the Brill-Noether locuses: 

Mc{2,K,n) ^{[E] \ h"{E) >n + 2} C Mc{2,K). (4.3) 

In the case n = —1, we write S for Mc{2, K, This is a codimension 1 

subvariety, and we call the corresponding line bundle Cm (2) the determinant 
line bundle of Mc{2, K). Its fiber at the point [E] is naturally isomorphic to 
the 1-dimensional vector space 

det H'^{E)(g)dctH^{E)''. 

Moreover, the canonical divisor of Mc{2,K) is given by 

Km ~ -4S, (4.4) 

and this extends as a linear equivalence of Cartier divisors to the compactifica- 
tion Mc(2,if). 

We give Mc(2, K, n) a subscheme structure in essentially the same way as for 
W^. We fix an effective divisor D of degree > g—1; then for every E G Mc{2, K), 
we have 

H^{E{D)) = H°{E{-D)) = 0. 
The short exact sequence of sheaves on C 

^ E E{D) ^ E{D)^^ (4.5) 
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induces a cohomology long exact sequence 

^ H'^iE) ^ H'^iEiD)) ^ ^ H\E) -> 0, (4.6) 

so that h^{E) — 2 deg D — ranka^. Next, we globalize a^; to a homomorpliism 
A: l[H°iEiD))^l[H'iE{D)^^) 

E E 

of vector bundles over the moduh space Mc{2,K), and define the subscheme 
structure of Mc(2, K, n) as its degeneracy locus (We omit the tech- 

nical question of how to deal with the fact that the universal bundle does not 
exist.) 

Applying Proposition \ fl to L'"+^(yl) gives the estimate: if Mc{2, K,n) is 
nonempty, then 

diinMc{2,K,n) > 3g - 3 ~ {n + 2)"^ . 
However, this is pretty feeble; the right estimate is the following: 

Theorem 4.7 (1) If Mc{2, K,n) is nonempty then 

dimMci2,K,n) > 3.g - 3 - (n + 2)(n + 3)/2. 

(2) Write a for the right hand side of this inequality. Moreover, suppose that 
for some E € Mc(2,_ftr), the space H'^(E) has dimension exactly n + 2. 
Then Mc{2, K, n) is nonsingular at [E] of dimension a if and only if the 
linear map defined by multiplication ( which we call the Petri map ) 

S^H°{E) H"{S^E) ^ H\5lE)'' 



is infective (see (3.i) for H^(slE)). 

To prove the theorem, we need to consider Mc{2, K,n) with a different 
structure. We e xpla in this in the following section. The analog of the classic 
existence result (2^) for Mc{2, K,n) is an unsolved problem: 



Problem 4.8 (1) Suppose that in Theorem I^A, (1), the right hand side is 
> 0; then is it true that Mc(2, K,n) 7^ 0? (Here we put M to allow 
semistable bundles.) 

(2) Does equality holds in (1) of the theorem for a general curve C G Mg ? 

The cases in which Mc{2, K, n) is well understood are shown in the following 
table (compare also @). Here the curve C is assumed to satisfy suit- 

able generality assumptions, which we omit. Case (6) of the table is described 
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in more detail in §8. 





9{C) 


dim Mc (2, K) 
= 3g-3 


n+2 


dimension 


Mc[2,K, n) 
and its boundary 


(1) 


3 


6 


2 


3 


cone over Veronese P^, 
the boundary is = C 


(2) 


3 


6 


3 





single point 


(3) 


4 


9 


3 


3 


singular cubic 3-fold 


(4) 


5 


12 


4 


2 


D quintic curve 


(5) 


6 


15 


5 





single point 


(6) 


7 


18 


5 


3 


Fano 3-fold of genus 7 


(7) 


8 


21 


6 





single point 


(8) 


9 


24 


6 


3 


singular quartic 3-fold 


(9) 


11 


30 


7 


2 


polarized K3 of genus 11 



5 Lagrangian formalism for Brill— Noether 
locuses 

Let D be an effective divisor of degree > .g — 1 . Instead of the exact sequence 
(4.£), we consider 

Q ^ E{-D) ^ E{D) ^ Ae ^ (5.1) 

The cokernel is an Artinian sheaf with the same support as D, and Ve = 
H^{Ae) is a vector space of dimension 4degD. Consider the skewsymmetric 
bihomomorphism 

E{D) X E{D) ^ ^^E{D) = Kc{2D), (5.2) 
and the induced map 

Aex. Ae-' K{2D)/K. (5.3) 
We take global sections, and compose with the residue map 

H°{K{2D)/K) H^Kc)^C 
(^p)p ^ EpeSuppD^eSpWp 

to obtain a skewsymmetric bilinear map 

( , ) : VexVe ^ H^{S^E) ^ C, 

{ifp)p^{9p)p) ^ EpeSuppD^-eSp/pASp. 



(5.4) 
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Now the original pairing (^) was nondegenerate, so that ( , ) is also nondegen- 
erate. Thus Ve is a symplectic vector space; moreover, it contains two naturally 
occurring Lagrangian subspaces. One of these is 

^loc ._ H\E/E{-D)), (5.5) 

which is obviously Lagrangian by definition. The other is 

U^' := im[H°{E{D)) Ve ^ H"{E{D)/E{-D))] . (5.6) 

First, the Riemann-Roch formula gives 

dimL''^' = h°{E{D) - h\E{-D)) 
= x{E{D)) = 2degD, 

that is, exactly half the dimension of Ve- The fact that the skewsymmetric 
pairing ( , ) restricts to zero on U^* is a consequence of the following standard 
result. 



Residue Theorem 5.7 If lo is a rational (Abelian) differential on a curve C 
then the sum of its residues is zero: ^pReSptJ — 0. 

The following statement is obvious: 



Proposition 5.8 (p^) The image of H^{E) Ve is exactly the intersection 
of the two Lagrangian subspaces described above: 

im[H°{E) Ve] = n L'^'K 

Now L^°'^ n L'^^^ is the kernel of the composite homomorphism 



but we note that this map is nothing other than in (4.6). 

Globalizing the above argument is routine. We assume for the sake of conve- 
nience that the universal bundle exists. Then we can construct a vector bundle 
V over the moduli space Afc(2,if), together with a skewsymmetric bihomo- 
morphism ( , ) : V x V ^ $ and two Lagrangian subbundles C'^^ C V, so 
that at each point [E] e Mc{2,K), the fiber is Ve, together with as 
above. Taking deg D to be sufficiently large, we get the following: 

Proposition 5.9 At each point [E] of the moduli space Mc{2, K), we have 

H°{E)^Cf^^nCl^y, 

therefore the Brill-Noether locus Mci'i, K,n) coincides with the degeneracy lo- 
cus D"^^^ {C^°'^ , C"^^) of the pair {C^°'^ , C'^^*^) of Lagrangian subbundles ofV. 



Thus Theorem 4.7 follows from Proposition Moreover, from the exact 
sequence (L9) and a calculation, we get the following result. 
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Proposition 5.10 If n is odd then Mc{'2, K,n + 1) = 0. Assume in addition 
that the Petri map S'^H°{E) H°{S'^E) is injective for every E S Mc(2, K, n). 
Then the canonical bundle of Mci2,K,n) is isomorphic to the restriction of 
OMiin — 5)/2); here 0]\i{l) is the determinant line bundle of the moduli space 
Mc{2,K). 



6 Non-Abelian Brill— Noether locuses of Type II 

We say that a pair (F, E) of rank 2 vector bundles over a curve C has canonical 
difference if /\^F (g) Kc = /\^E. We want to consider Brill-Noether locuses 
for such pairs, defined in terms of the space of homomorphisms Hom(i^, E). In 
this vein, we could of course allow both of F and E to vary, but here we work 
with a fixed F. To start with, we write the dual bundle F'^ any-old-how as an 
extension of two line bundles, that is, we fix an exact sequence 

^ M F"" N 0. (6.1) 

Now tensoring this with E and taking global sections gives a long exact sequence 

H°{M (E)E)^ Hom(F, E) H"{N(E) E) 
^ H^{M®E) Ext^(F,£;) H^{N ®E) -> 0. 

The natural bihomoniorphism 

{N ®E) X {M (E)E) ^ N ®M (E) /\^E = Kc 

induces a cup product 

( , ) : H°{N (g>E)x H\M (g> E) ^ H^{Kc) = C, 

which is nondegenerate by Serre duality. On the other hand, a simple calculation 
with Cech cocycles shows that 

(s,(5s(s))=0 for aU s e i/°(iV «)£;). 



(6.2) 



Thus the connecting homomorphism 5e in ( |6.2D is skewsymmetric. In particular, 
rank 5b is even, so that we obtain the following. 

Proposition 6.3 Let (F, E) be a pair of rank 2 vector bundles over a curve C 
with canonical difference; then 

dimHom(_F, _E) = degF mod 2. 

Now, for any integer v > with v = dcgF mod 2, we define a subset of 
Mc{2,f\''F(g,Kc) by 

Mc{2,K: vF) {E \ dimHom(i^,S) > v] . 
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We can put a subscheme structure on Mc{2,K: vF) by using the globalized 



form of (6.2). For convenience, we explain this under the pretence that there is 



a universal bundle £ over C X Mc{2,/\^F (g) Kc), although of course no such 



thing exists when deg-F is even. Then pulling back the exact sequence (3.1) to 
the direct product and tensoring with £ gives a sequence 

0^£ ®Oc M ^ £ ®Oc ^ £ (E)Oc N ^ Q 

over C X Mc{'2., /\^F (g) Kc)- Taking direct images by the second projection tt 
gives 

-> 7r,(£ ig)Oc M) 7r»(£ <SiOc F"^) 7r,(£ <SiOc ^) 
A (6-4) 



The connecting homomorphism A restricted to every fiber equals the Se of (6.2), 
which is skewsymmetric with respect to Serre duality. Twisting by a suitable 
line bundle we can make A itself skewsymmetric with respect to Serre duality 
(relative to tt): 

R^Tr^{£ ®Oc M) = 7r,(£ <SiOc <S) $; 
compare the start of §7 for the twist $. 

Definition 6.5 We write Mc{2,K: vF) C Mc{ 2,/\^ F (g) Kc) for the sub- 



scheme defined as the Pfaffian locus P'^{A) (see ( 1. 10 )) of the twisted skew- 
symmetric vector bundle homomorphism A: 7r*(£ i^Qc ^) ~^ R^tt*{£ ®Oc 
and call it a non-Abelian Brill-Noether locus of Type II. 



Remark 6.6 To prove that this definition is independent of the choice of the 
extension ( |6.l| ) seems not to be all that easy, but it can be proved using a 
Lagrangian formalism for inner product bundles. 



By applying Proposition 1.11 to the above definition, we get the following 
result. 

Theorem 6.7 (1) If Mc{2,K: vF) ^ then 

diTCLMc{2,K: vF) > 3g - 3 - v{u - l)/2. 



(2) Write r for the right hand side of this inequality. Assume also that E £ 
Mc{2,/\ F®Kc) is such that }iom{F, E) is exactly v- dimensional. Then 
Mc{2,K: vF) is nonsingular of dimension r at [E] if and only if the 
linear map (called the Petri mapj 

Hom(i^, E) Hom(A^i^, S^E) 

is injective. 
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Moreover, from the exact sequence (1.13), we get the following result. 



Proposition 6.8 Suppose that ly is odd, and Mc{2, K : (i' + 2)F) — 0; suppose 
also that the Petri map is injective for all E S M(7(2, K: vF). Then the canon- 
ical class of Mc{'2, K : vF) is isomorphic to the restriction of Om{{v — 5)/2). 
Here Om(1) is the positive generator of the Picard group of the moduli space. 

7 Computing the fundamental class of a 
non-Abelian Brill— Noether locus 



We want to generahze to Mc{'2, K,n) and Mc{'2,K: vF) the formula (2.4) for 
the fundamental class of the locus of special line bundles. For this, we 
explain some facts we need concerning the cohomology of the moduli space 
Mc(2,^). What follows is taken from Newstead 0. 

First consider the odd moduli space M(7(2,^), which is compact, and for 
which the universal bundle £ exists. For each point [E] G Mc{2,(,) we have 
f\^£\cx[E] - = so that f\^£ $ Kl ^ for some line bundle Write 
for the first Chern class of $. Write out the Chern classes of £ separated into 
their Kiinneth components: 

ci{£) =<j) + df e H^{M) e H\C); 
C2{£) =x + i^ + ^®f 

for some x e H^{M), ^ e H^{M) ® H^{C) and uo e H^{M), where d = deg^ 
and / S H^{C) is the fundamental class. The only ambiguity in the choice of 
the universal bundle £ is tensoring with a line bundle on Mc(2,^), so that the 
2 cohomology classes 

a = 2w - d</> e iJ^(M); 

are independent of the choice of £. Also, ip is not itself a cohomology class of 
Mc(2,^), but setting 

=j(g)f 

gives a well-defined cohomology class 7 G H^{M). For our purposes in what 
follows, the 3 classes a, /3, 7 are all we need. The moduli space has complex 
dimension ig — 3, so that the intersection number (a™ • /3" • 7*^) is defined when 
m + 2n + ip — ig — 3. These numbers have been computed explicitly, to give 
the following result. 



Theorem 7.1 (Thaddeus ||43l, Zagier | |48[ ) 

■jIttj.I 



O ' 1 11 ' 

(a™ • /3" • 7^) = (_i)P-9_y__229-2-p/29 - 2)S„, 

{g-p)\q\ 
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where q = m-\-p-\-l — g and Bq is the qth Bernoulli number, defined by 

X ^1 X — ^ n 
= 1 - -x+ > B„- 



2- ' ^ ""g!' 

q even 

We set -Bo = 1 and Bq ^ for q < 0. 

The cohomology class a is the first Chern class of the positive generator of 
the Picard group of Alc{2, i^); thus when ri = p = 0, the number 

is the degree of the odd moduli space. 

We now compute the fundamental class of a Brill-Noether locus of Type II, 
under the assumption that it has the expected codimension. The whole point 
is the connecting homomorphism ( |6.4[ ) 

A : TT^f <g)Oc N) R^TT* {£ ®Oc M) . 

This vector bundle homomorphism is skewsymmetric under a nondegenerate 
pairing 

7r*(5 ^oc N) X <SiOc M) ^ $ 

with values in the line bundle <I> defined above. We can determine the Chern 
characters of the direct image by applying the Grothendieck-Riemaim-Roch 
formula to the virtual vector bundle £ ®Om ■> obtaining 



ch2„-i(7r4£ ®Oc ® 



-Is 



-a/2 forn = l, (j 2) 

^ ^ ' ' ' 7 / (2n- 1)! for n > 2. 



4/ V 8 2 



The evenly numbered Chern characters can also be calculated, but are not 
required because of Remark 1.14 . By Proposition |l.ll| , (4) we get the following 



result. 

Proposition 7.3 Suppose that the Type II Brill-Noether locus Md^jK: 3F) 
has codimension 3 in Mc{2,Kc/\^F). Then its fundamental class equals 

(a^ -a/3 + 47)/24. 

Example 7.4 If the genus of C is 2, 3, 4, 5, then under the assumption of Propo- 



sition 7.3, Mc{2, K : 3F) has degree (relative to a) equal to 1, 16, 2544, 1231616. 
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Next, we consider the even moduli space Mc(2, p)). Rather than the 
Brill-Noether locus inside this, we take its puUback to the Hecke graph Z of 
(^^), and determine the fundamental class of this puUback. By definition, we 
have ci(£'p) = a and C2{Sp) = (a^ — /3)/4. Thus writing H for the tautological 
divisor of Z = ¥{£p),we find that H"^ = aH — {p? — j3)/A. (We continue to write 



a,P,'y for their pullbacks to Z.) Using this, together with Theorem 7.1 and the 



recurrence formula for the Bernoulli numbers, we get the following result. 

2n + 3p = 3g — 3, the intersection number in the 



Proposition 7.5 For m 4 

Hecke graph Z is given by 



/3" • 7^) - 



(-l)P+92f 



glm\ 



(-1) 



{g-py- 



here q and Bq are as in Theorem 7.1 . 

By dU), we get 

ci{T) = a + (rf - 1)/ e i/2(C X Z), 

C2(^) =x + i^+{H+{d- l)a/2) ® / e H'^{C x Z), 



for the Chern classes of the universal vector bundle over C x Z. As in (7.2), 
we get 



ch2„-i(7r,(.F(-a/2) 
H 

4 



n-2 



N)) = 



(3H 



for n — \, 



7 / (271 - 1)! for n > 2. 



(7.6) 

(Th us in effect, we just substitute H for a/2 in (7^).) Similarly to Proposi- 
tion 



7.3, we get the following result. 



Proposition 7.7 Suppose that the Type II Brill-Noether locus Mc{2,K: 4F) 
has codimension 6 in Mc{2, Kc f\ F). Then its puUback to Z has fundamental 
class equal to 

h^-f j^ + h^(3 hp-f h^0^ 
_ + _ 4- _ 



45 



36 



45 



180 



The pullback to Z of the linear system \a\ on Mc(2,^) defines a map from 
Z to Mg(2, ^(— p)) which is a double cover over the generic point. Thus by 
Proposition |7.5| , one can calculate the degree of the Brill-Noether locus with 
respect to the determinant line bundle. 

Example 7.8 If the genus of C is 4, 5, 6, then under the assumption of the 



Proposition 7.7, the degree oi Mc{2,K: AF) equals 6, 256, 28640. 
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The fundamental class of Brill-Noether locus of Type III can be determined 
by applying Pragacz's formula |^ to their Lagrangian representation (see §5). 



Proposition 7.9 For n = 0, 1 or 2, suppose that Mc(2, K, n) has codimension 
exactly ("^■^) in the moduli space Mc{2, K). Then its pullback to the Hecke 
graph Z has fundamental class given by 

, , h^ hB 

6 6 3 

h^ h'^P h^-f h^P^ 2h(3j 7^ , „ , 

(2) H H - — when n + 2^3; 

^ ' 360 72 36 90 45 18 ' 

/iio h^(3 h'^j nh'^fi^ nh^p^-f h^p-f^ 

^' 302400 ~ 20160 10080 ~ 60480 10080 ^ 720 

h^P^ hj^ hp^j 3p^j' h^P^ h^p-l 

H when n + 2 = A. 

8400 216 1050 2800 4800 1200 

8 Fano 3-folds of genus 7 

The Brill-Noether locus Mc{2,K,3) C Mc{2,K), that is, the set of E such 



that hP{E) > 5, has expected codimension 15. By Proposition 5.1C , if the 
codimension is as expected, the anticanonical line bundle is the restriction of 
the determinant line bundle of Mc(2, K). In particular, it is a Fano variety. We 
consider the case when C has genus 7. 

Theorem 8.1 Let C be a curve of genus 7 not having a special line bundle g\. 
(This just means that C cannot be expressed as a cover of the Riemann sphere 
of degree < A.) Then the Type III Brill-Noether locus Mc{2, K,S) is a Fano 
S-fold of Picard number 1 and genus 7. 

We study this variety from the following two points of view: 

(1) the construction of birational maps and the intermediate Jacobian variety; 

(2) the degeneration of Fano 3-folds and moduli spaces. 

There are a number of ways of constructing birational maps; here we explain 
the simplest, which is obtained from 2 points p,q E C. Note that for an element 
[E] G Mc(2, AT, 3), we have h°{E{~p- q)) > 5-4 = 1, that is, E has a nonzero 
global section with zeros at p and q. If we assume that this section has no other 
zeros, we obtain an exact sequence 

0^Oc{p + q)^E^Kc{~p-q)^0. (8.2) 

Conversely, consider the question of when a vector bundle E obtained as an 
extension of the line bundles Kc{—p — q) and Oc{p + q) has h°{E) > 5. By 
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Serre duality, the vector space of extensions F,xt^{Kc{—p — q),Oc{p + <?)) is 
dual to H°{Kl;{-2p ~2q)). Thus if we write 

$: C P" = V*H"{Kl{-2p~2q)) 

for the embedding defined by K^{—2p— 2q)), a nonzero extension class e € 
Ext^ {Kc{—p — q),Ocip + q)) determines a point of this P^^. We write 

S,: H"{Kc{-p - q)) ^ H\Oc{p + q)). 

for the connecting homomorphism in the cohomology sequence of the exact 
sequence ( |8.2| ) determined by e. The condition h^{E) > 5 is equivalent to 
saying that 6e has rank < 1. Moreover, the linear map 

Ext\Xc(-p -q),Oc{p + q))^ Rom{H"{Kc - p - q), H\Oc{p + q))) 

given by e I— > is the Serre dual of the multiplication map 

H''{Kc{-p-q))®H''{Kc{-p-q))^ H\K-'{-2p-2q)). 

Now consider the diagram 

C Pl3 

p4 ^ pl4 

Veronese map 

The condition rankfJe — 1 means that the point P*/i(p) is in the image of the 
Veronese map. Thus the set of nontrivial extensions E with h^{E) > 5 is 
parametrized by the quadric hypersurface C P* which passes through the 
image Cio = 'bKc(-p-q){^)- The vector bundle E correponding to a general 
point of this quadric Q'^ is stable, and we obtain a birational map 

Mc{2,K,3) Q\ 

Taking a closer look at this correspondence, we find that this birational map 
factors as follows. 

(8.3) Write Jp^g for the set of e Mc{2,K,3) with h°{E{-p- q)) > 2; it 
is a rational curve of degree 2 with respect to the anticanonical class (or the 
determinant line bundle). Jp g is clearly contained in the indeterminacy locus of 

the birational map Mc(2, K, 3) > Q^, so that we blow up Mc(2, K, 3) along 

it, writing Mc{2, K, 3) for the blowup. 

(8.4) A vector bundle E obtained as the extension corresponding to a point x 
of the curve Cio C C P* contains the line subbundle Kc{~p~ q — x), and is 
not stable. Therefore, it is contained in the indeterminacy locus of the inverse 

birational map > Mc{2, K, 3). Thus we write for the variety obtained 

by blowing up the quadric hypersurface Q"^ along Ciq. 
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(8.5) The two blowups Mci^, K,3) and are isomorphic outside a subset 
of codimension 2. In fact, Mci^, K,3) is obtained from by flopping the 
birational transforms of the lines contained in Q"^ which are trisecant lines of 
Cio (there are 14 of these in general): 

\ y 

blowup i Xe^ (2) n (3) C i blowup 



3 ^ mi 



Mc(2, K) D Mc{2, K, 3) D Jp,, Cio C c 

Here is the common anticanonical model of Mci'i, K,3) and Q^, so that 
these are two different small resolutions of the singular Fano 3- fold Xe- 

Because flops do not change the intermediate Jacobian, we get the following 
result. 

Theorem 8.6 Mc(2, K,3) is rational, and its intermediate Jacobian is iso- 
morphic as a principally polarized Ahelian variety to the Jacobian of C . 

In particular, the Torelli theorem holds for Mc(2,i^, 3). Moreover, it can 
be shown that every nonsingular Fano 3-fold of genus 7 and Picard number 1 
is isomorphic to a Mc{2.,K,'i). By the above theorem, their moduli space is 
isomorphic to the moduli space of curves of genus 7 not having a g\ . 



Although we restricted Theorem 3.1 to the nonsingular case, even when 



singular, the moduli space Mci^., K,?i) extends in a flat family, provided it 
remains 3-dimensional. Moreover, its singularities are all Gorenstein. There are 
two main directions of degenerations: 

(a) when C has an ordinary double point; 

(b) when C remains nonsingular, but acquires a g\, that is, it specializes to a 
4-fold cover of the Riemann sphere. 

In either case, we obtain a Fano 3-fold of genus 7 having an ordinary double 
point. In the two cases, the (algebraic) local ring of the double point is a unique 
factorization domain in Case (a), and not so in (b). 

We take a closer look at Case (a). A curve C of genus 7 with an ordinary 
double point is obtained by identifying two points p, q on a nonsingular curve C 
of genus 6. In the moduli space M~{2, K{p + q)) of stable rank 2 bundles over 

C, consider the locus M~{2, K{p -I- g), 3) of bundles having h°{E) > 5. 

Proposition 8.7 Suppose that the genus 6 curve C is not trigonal, and write 
Cg C P"^ for the image of C under <l';f(_p„q). Then Mc{2, K{p + q),3) is 
obtained by blowing up in C%, then flopping the birational transforms of its 
5 quadrisecants. 
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The curve Cg C P'^ is contained in a cubic surface. After the flops, its 
birational transform becomes isomorphic to x P^, and can be contracted 
to an ordinary double point. The singular manifold so obtained is the Brill- 
Noether locus of the curve in (a). However, the node itself corresponds not to 
a vector bundle over C, but to a torsion free sheaf. 

9 Fano 3-folds of genus 9 

A nonhyperelliptic curve of genus 3 is isomorphic to a plane quartic curve. 

Theorem 9.1 Let C be a nonsingular plane quartic curve, and F a rank 2 
vector bundle over C of odd degree such that any section S of the associated 
bundle P(i^) has selfintersection number >2>. Then the Brill-Noether locus 
of Type II Mci'i, K: 3F) is a nonsingular Fano S-fold of index 1 and genus 9. 
Here the fact that M is Fano follows from Proposition |g.4 and genus 9 from 
Example \7.^ . 

Remark 9.2 The vector bundle F is stable; in fact F is stable if and only if 
every section S has selfintersection number > 1. 

If we twist by a line bundle to get F (g) L, the isomorphism class of 
Mci2,K: 3F) does not change. Thus the Fano 3-folds Mc(2,X: 3F) depend 
only on the ruled surface P{F). 

As for the Fano 3-folds of genus 7 in the preceding section, the various 
properties of a Fano 3-fold of genus 9 can be studied via vector bundles in terms 
of moduli theory. We first construct a birational map. Let S* be a section of 
P(F) with selfintersection S'^ — 3; in terms of the exact sequence 

O^^^F^r]^0 (9.3) 

associated with S, this means that deg?7 — degf — 3. 

Proposition 9.4 The locus of E e Mc{2,K: 3F) such that H^{r]-'^E) is a 
rational curve of degree 1 with respect to the anticanonical divisor. 

We call this locus the line associated with 5, and denote it by 1$. Next, 
write Ct C P"* for the image of the embedding $: C ^ H^iKS^-^rj). By 
Serre duality, Ext^(77,^) = H^{K£_~^riY , so that the class of the extension ( |9.3[ ) 
determines a point p e P**. Since F is stable, p is not on C7. Furthermore, 
since P(i^) does not have a section of selfintersection 1, it is not contained on 
the secant hypersurface of C7. We write Gs C P^ for the nonsingular degree 7 
space curve obtained by projecting C7 from p. 

Theorem 9.5 Let C, F and S be as above. Write Mc{2,K: 3F) for the Brill- 
Noether locus Mc{2,K: 3F) with the line Is blown up and P^ for P^ with the 
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curve Cs blown up. Then these are isomorphic outside a set of codimension 2, 
and are obtained from one another by flops: 

\ / 
blowup i Xi2 CF^ i blowup 

Is C Mc{2,K: 3F) C Mc{2, KA) D C's 



Here X12 is the common anticanonical model, as in (8.6). 

A point x e P'^ of the projective space containing the degree 7 curve Cs 
determines a 3-dimensional vector subspace Ux C H^{K£^^^rj). If x ^ Cs then 
the evaluation homomorphism 

ev^ -.Uxf^Oc-^ KC'^r] 
is surjective. Now we consider the kernel of 

evx (S> : Ux (S> KC'^r], 

writing for its dual. We always have dimHom(i^, E^) > 3. Moreover, if x is 
not on any quadrisecant of C then E^ is stable. This defines a rational map 

p3 > Mc{2,K: 3F) given by a; [E^]. (9.6) 

The inverse can also be constructed, proving the rationality of Mc{2,K: 3F), 
but we omit the details. 

Similarly to Theorem 8.6, we obtain the following result. 

Corollary 9.7 The intermediate Jacobian of Mc(2, K : 3F) is isomorphic to 
the Jacobian of the curve C . 

There are 3 main ways in which Mc{2, K : 3F) degenerates. The first two of 
these are similar to the degenerations of Mc(2, K, 3) in the preceding section. 

(a) when C has an ordinary double point; 

(b) when C specializes to a hyperelliptic curve; 

(c) finally, when the bundle F is no longer general: namely, suppose F is 
stable, but its projectivization P{F) has a section with selfintersection 1. 

In any of the 3 cases, Mc{2, K : 3F) acquires a single ordinary double point. 
Its local ring is a unique factorization domain in Case (a) only. We discuss 
Case (c) briefiy. In this case, F can be written as an extension 

0->Oc^F->A->0, 

where A is a line bundle of degree 1. Suppose that h'^{F) = 1; then by Serre 
duality, h°{KcF'^) = 4. Also, K^K-^ embeds C into P^. Write C7 C P^ for its 
image. The Grassmann map determined by the sections of KcF^ determines a 
quadric hypersurface Q'^ containing C7. 
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Proposition 9.8 In Case (c), Mci^jK: SF) is isomorphic to the anticanoni- 
cal model of the blowup of Cj in . 

C7 C has a single trisecant line. The birational transform of this can 
be contracted to the ordinary double point of the anticanonical model, and 
Mc{'2,K: 3F) is nonsingular outside this point. 



10 The non-Abelian Albanese map 
of a K3 surface 

We give an application of Brill-Noether locuses of Type III to K3 surfaces, and 
to the relation between curves and K3s. Harris and Mumford have computed 
the Kodaira dimension of the moduli space of curves, and obtained the following 
result: 



Theorem 10.1 (|10|) For sufficiently large g, a general curve C £ AAg is not 
isomorphic to a hyperplane section of a surface S C P^. 

Here we consider the case when is a K3. 



Problem 10.2 Determine whether a given curve C can be embedded in a K3 
surface; if so, analyze the set of all such embeddings. 



Definition 10.3 If some embedding of C into a K3 exists, we say that C is a 
K3 curve or a K3 section. 

If a curve C of genus g > 2 is contained in a K3 surface S, then as a divisor, 
it is nef and big on S. In fact |C| is base point free, and C"^ — 2g — 2 > 0. Write 
h for the linear equivalence class of the image of C ^ S'. In what follows we 
consider the case that h is primitive in Pic S, that is, not divisible by a natural 
number > 2. 

A K3 surface {S, h) together with a (primitive) nef and big divisor is called a 
polarized K3, and the natural number g = h'^/2+1 its genus. We write for the 
moduli space of polarized K3 surfaces {S, h) of genus g. It is a 19-dimensional 
quasiprojective algebraic variety. We also write Vg for the moduli space of pairs 
(5, C) consisting of a K3 surface together with a genus g curve on it; this has 
natural projection maps to Tg and Aig, which we write ^! g and 

Vg = {{S,C)}l\so ^ U(s,h)er,\h\ 

^g/ \ *g / Pf -bundle 

Mg^JCg Tg^{{S,h)}/iSO 

K3 curves polarized K3s 

By definition, the image of <I>g is the locus of K3 curves; we write JCg for it, and 
ipg for the restriction of <^g over it. The moduli space Vg is contained as an 
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open subset in the P^-bundle over Tg having fibers the complete hnear systems 
\h\ ~ Ps. Therefore, its dimension is 19 + g. In particular, we get the following: 

diniT'g < dimA^g 19 + .g < 3.g - 3 .9 > H- (10.4) 



Main Conclusion 10.5 For a curve of odd g en us g > 11, we can construct 



the inverse of (pg as a rational map. See ( 10.14 )-( 10.18|) for details; for g = 11, 
see also 



Corollary 10.6 For odd g > 11, the locus of K3 curves ICg is birationally 
equivalent to a -bundle over Tg. 



Remark 10.7 (1) In spite of what inequality ( 10.4 ) may suggest, the pro- 
jection </3i2 : 7^12 ^ A^i2 C A1i2 is not even generically finite. The reason 
behind this phenomenon is the existence of the Fano 3-folds V22 C P"'^^ of 
genus 12, discovered by Iskovskikh. In fact, the general element of Kin 
can be written as a double hnear section C — V22 H HiH H2, so that C is 
contained in infinitely many K3s, namely the pencil V22 H {aiHi + 02-^2) 
for (ai : 02) G P^ 

More generally, the values of g for which tpg is not birational are exactly 
the values for which there exists a Fano 3-fold V with PicV = Z{~Kv) 
(explicitly, all odd numbers g < 9 and all even numbers g < 12). 

(2) It was proved in that (pg is generically finite for odd 5 > 11. For genus 



11, Corollary 10.6 also follows from the theorem of Ciliberto and Miranda 



on the irreducibility of the fiber of ipu. 

(3) We do not treat this here, but there are theorems of J. Wahl (Q, @), 
saying that the Gauss map /\'^H'^{Kc) — » H'^{K^) is not surjcctivc for 
K3 curves C. 

The construction of the inverse, that is, recovering a K3 surface from a K3 
section C € /Cg is a non-Abelian version of the Albanese map. We first recall 
the theory of the dual of an Abelian variety. If A is an Abelian variety, the dual 
Abclian variety A is the identity component Pic*^ A of the moduli space Pic A 
of line bundles on A; there is a universal Poincarc line bundle V over the direct 
product A X A. By definition, A 3 a 1-^ '^\Axa ^ Pic" ^ is an isomorphism. 
We can normalize V by the condition that V\„ t is trivial, then consider its 

\OxA ' 

restriction to the fibers in the other direction a x A. 

Duality Theorem 10.8 (]28[, §13) The correspondence a t-^ '^\axA '^^fi''^^^ 
an isomorphism A^A. 
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Corollary 10.9 // X is a nonsingular projective algebraic variety, the dual 
Abelian variety of the Picard variety Vic^ X is the Albanese variety of X. That 
is, there exists a morphism a: X ^ (Pic° X)^, which has the universal mapping 
property for maps from X to an Abelian variety. 



Remark 10.10 (1) The Albanese variety is constructed analytically by pick- 
ing a basis uji, . . . ,ujn G H'^{X, regular differential 1-forms on X, 
and then taking the integral 

X C"/ (periods) 

UJl, . . 



(2) In positive characteristic, if Pic° X is nonreduced, we have to replace 
Pic° X by its reduced Abelian variety before taking the dual. 

We define a non- Abelian version of the above duality theorem for K3 surfaces 
(see for details). Let (S, h) be a polarized K3 surface of odd genus g = 2n+l. 
Consider the moduli space 



Ms{2,h,s) :={£ 



E is a rank 2 stable sheaf, with 
ciiE) = h and x{E) =s + 2 



(isomorphism) 



This is nonsingular and of dimension 2{g — 2s) (see [|l8[, [Q, |^). In particular, 
when s ^ n — {g ~ l)/2, it is a surface; we denote it by S* = Ms{2,h,n). We 
assume in what follows that n is also odd, so that 3 = 3 mod 4. 

Proposition 10.11 Assume that S is compact. (This is equivalent to saying 
that all semistable sheaves are stable.) 

(1) S is a K3 surface. 

(2) There exists a polarization h of S having the same degree as h. 

(3) There exists a universal vector bundle £ over the direct product SxS with 
ci{£) = TTgh + Tr'^h; (we call this the normalized universal vector bundle). 

By definition, the correspondence a t—^ defines an isomorphism S—> 

Ms {2, h, n); restricting to the fibers in the other direction gives the following. 

Duality Theorem 10.12 Let {S,h) & Tg be a general element, with 3 = 3 
mod 4, and let £ be the normalized universal vector bundle. Then the corre- 
spondence s ^jg^g^ defines an isomorphism from S to S . 
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Remark 10.13 (1) The correspondence {S,h) i~> {S,h) extends to an au- 
tomorphism of the moduh space Tg. When 17 = 3 (that is, for space 
quartics), it is the identity map, for .g > 7, a map of order 2. 

(2) In general, we have S ^ S for g > 7, but the derived categories of coherent 
sheaves on S and S are equivalent under an integral transformation. That 
is, as in there is an equivalence of categories D(Coh 5)^D(Coh S"). 

The construction of the inverse of (pg: Vg JCg is as follows. We assume 
that C € /Cg is a general K3 curve of genus g > II with g = 3 mod 4. 

(10.14) Consider the moduli space Mc{'2,K) of vector bundles over C, and 
the Brill-Noether locus of Type III Mc{2,K,n), where n = {g - l)/2. Then 
Mc{2, K,n) is a K3 surface, and the restriction to it of the determinant line 
bundle of Mc(2, K) is a polarization of genus g. We write (T, h^ct) for this pair. 

(10.15) There exists a universal vector bundle £ over the direct product C x T 
such that ci{£) = ttqKc + nghdet- 

(10.16) For every p £ C, the restriction of £ to p x T is a stable bundle, and 
has x — n + 2. 

(10.17) The correpondence p 1-^ £\ defines a classifying map C T ^ 
Mt(2, ft-dct, f^), which is an embedding from C to the K3 surface T. 

(10.18) Every K3 surface containing C is isomorphic to T. 

To summarize what we have said above, there is a double moduli construc- 
tion, starting from a moduli space of vector bundles over C, giving a non-Abelian 
Albanese map C ^ T; namely, T is the dual K3 surface of a Brill-Noether locus 
of C. 

When g = I mod 4, we find in a similar way that T = Mc{2, K,n) is a 
K3 surface. But now h^et is divisible by 2, and the universal vector bundle £ 
does not exist globally over it. However, there does exist a universal P^-bundle 
corresponding to F{£), and the K3 surface containing C can be recovered as a 
moduli space of suitable P^-bundles over T (we can equally well say principal 
S0(3)-bundles). 
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